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This paper presents the optimal control modification for linear uncertain plants. The Lyapunov analysis 
shows that the modification parameter has a limiting value depending on the nature of the uncertainty. The 
optimal control modification exhibits a linear asymptotic property that enables it to be analyzed in a linear 
time invariant framework for linear uncertain plants. The linear asymptotic property shows that the closed- 
loop plants in the limit possess a scaled input-output mapping. Using this property, we can derive an analytical 
closed-loop transfer function in the limit as the adaptive gain tends to infinity. The paper revisits the Rohrs 
counterexample problem that illustrates the nature of non-robustness of model-reference adaptive control in 
the presence of unmodeled dynamics. An analytical approach is developed to compute exactly the modification 
parameter for the optimal control modification that stabilizes the plant in the Rohrs counterexample. The 
linear asymptotic property is also used to address output feedback adaptive control for non-minimum phase 
plants with a relative degree 1. 


I. Introduction 

Research in robust adaptive control was motivated by instability phenomena of adaptive control. In fact, instability 
of adaptive control in the early 1960’s which contributed to the crash of one of the NASA X-15 hypersonic vehicles 
caused a great deal of concern about the viability of adaptive control. The standard model-reference adaptive control 
is well-known to be non-robust in the presence of time delay, unmodeled dynamics, and disturbances. Rohrs et al. 
investigated instability mechanisms of adaptive control due to unmodeled dynamics in the 1980’s. * 1 Thus, the field 
of adaptive control has seen numerous robust modification techniques developed to improve robustness. As a result, 
various robust modification schemes had since been developed to ensure boundedness of adaptive parameters. The 
o modification 2 and e modification 3 are two well-known robust modification methods. Other techniques such as the 
deadband and projection methods are also used to improve robustness of adaptive control algorithms. In recent years, 
there have been various new advanced robust adaptive control methods being developed such as the method, 4 
optimal control modification, 5 - 6 adaptive loop recovery, 7 composite model reference adaptive control, 8 and many 
others. The principle of robust modification is based on two central themes: 1) limiting adaptive parameters and 2) 
adding damping mechanisms to model-reference adaptive control. The robustness issues with parameter drift, non- 
minimum phase behaviors, time delay, unmodeled dynamics, and fast adaptation are largely ameliorated with these 
robust modification schemes, but are not entirely eliminated if the nature of the uncertainty is not completely known. 

Robust adaptive control achieves robustness by compromising the ideal property of asymptotic tracking of MRAC. 
All robust modifications in adaptive control result in bounded tracking and adaptive parameters when they are properly 
designed. Recognizing this important requirement of robust adaptive control, the optimal control modification is a 
recent development of robust modification in adaptive control that addresses adaptive control in the framework of 
optimal control. More specifically, the optimal control modification is designed to minimize the tracking error norm 
bounded away from the origin by some lower bound. 

In this paper, we revisit the Rohrs counterexample problem that illustrates the nature of non-robustness of MRAC 
in the presence of unmodeled dynamics and develop an analytical approach that computes exactly the modification 
parameter using the optimal control modification to stabilize the plant in the Rohrs counterexample. The optimal 
control modification exhibits a linear asymptotic property that enables it to be analyzed in a linear time invariant 
framework when the uncertain plant is also linear time invariant. Using this property, we can derive an analytical 
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closed-loop transfer function in the limit as the adaptive gain tends to infinity. In contrast, both the cr modification and 
e modification can stabilize the Rohrs plant as well, but the modification parameters are chosen ad-hoc. 


II. Optimal Control Modification for Linear Time Invariant Uncertain Systems 

Consider the following linear time invariant system with matched uncertainty 

x = Ax + B ( u + ©* T x 


(1) 


where x(t) £ M" is a state vector, u (f) £ R m is a control vector, A £ R" x M." is known, B £ R' !Xm is also known such 
that (A,B) is controllable, 0* £ R" xm is the unknown parameter constant matrix, where w is a unknown bounded 
disturbance 

The reference model is given by 

■fm = A m x m T B m r (2) 

where A m £ K" x M" is known and Hurwitz, B m £ K" x M r is known, and r (f) £ K r is a bounded reference command 
signal. 

Assuming that there exist matching model conditions 


Then adaptive controller is designed as 


A + BK X — A m 
BK r = B m 

u = K x x + K r r — © T x 


Defining the tracking error as e = x m — x , then the error equation is obtained as 

e = A m e + B& r <t> (x) — w 

The adaptive parameter © can be estimated using the optimal control modification adaptive law as 


© = -fx (e T P - vx J &B J PA m l 


B 


( 3 ) 

( 4 ) 

( 5 ) 

(6) 

( 7 ) 


where T = T t > 0 £ R nx " is a positive-definite adaptive gain matrix, V > 0 £ R is the optimal control modification 
parameter, and P = P T > 0 £ R" x ” is a positive-definite matrix that solve the following Lyapunov equation 

PA m +Aj n P = -Q ( 8 ) 

where Q = Q r > 0 £ R” x " is a positive-definite weighting matrix. 

Theorem 1: The optimal control modification adaptive law is stable for any modification parameter 0 < v < V max 
where 

A min ( Q)kmin{B T A m T QA m 1 B ) 


^ max — 


\\B T PA m l B\\~&l 

with ©o = max ||@* || as the upper bound on the parametric uncertainty. 
Moreover, if © is a non-destabilizing parametric uncertainty, then 


( 9 ) 


V>nax — 


4 Kin ( B J A m J QA m l B ) ||Pfl|| 
Kin(Q)\\B J PA m 1 B \\ 2 


(10) 


independent of the upper bound on the parametric uncertainty ©o. 

Proof: Choose a Lyapunov candidate function 

V (e,&) = e T Pe + trace ^^T -1 © 

Differentiating V (e. 0) yields 
V ( e , ©) = - e J Qe + 2e T PB@ T x - 2e J Pw - 2trace 


(11) 


© T x ( e T P - Vx J &B J PAR} 


B 


= -e T Qe-2e T Pw + 2vx T &B T PA m 1 B& T x + 2vx T &*B T PA m i B&' x (12) 


-1 
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PA m l can be decomposed into a symmetric part M and anti-symmetric part N as 

PA m x =M + N 

where 

M = \ (a-^ + PA- 1 ) = < 0 

N= 1 -(PA~ 1 -A- T py 

Since the symmetric part M < 0, therefore PA ~ 1 < 0. Thus, V (e. ©) becomes 

V (e, ©) = -e T Qe-2e T Pw-Vx J ®B T A m T QA m l B® J x + 2vx T ®*B T PA m l B® T 4 
and is bounded by 

v (e,&) < -Kin (Q) Ikll 2 + 2A max (P) ||e|| w 0 - vA min (b j A m J QA m l fl) ||x || 2 ||©f + 2v ||z? T ^A m 1 J B|| ||x|| 


(13) 

(14) 

(15) 

(16) 


S' PA~ l B 


[N 


ixini©i|0o 

(17) 


Let Cl = Kin ( Q ) > o, c 2 = *"" c ( f )wo > 0, c 3 = Kin {B T A m J QA m x B) > 0, and c 4 = "" ""“ u > 0. Then, upon 

(18) 


completing the squares, one gets 

V (e, ©) < -ci (||e|| — c 2 ) 2 + C1C2 — Vc 3 ||x|| 2 (||©|| - c 4 )“ + VC3C4 ||x|| 2 
V (e,©) < 0 implies 


.2 IM|2 


ll e ll >C2 + \ Cj + 


Vc 3C 4 ||x|| 


Cl 


|©|| > C4+ i C^-\ ClCl - 

1 V vc 3 ||x|| 2 


a 


(19) 


(20) 


Note that the lower bounds r and a are dependent on ||x||. Therefore, to prove boundedness, we also need to show 
that ||x|| is bounded. To this end, we see that Eq. (19) 


is equivalent to 


There are two cases to consider: 


-ci \\e\\ 2 + 2c l c 2 \\e\\ + vc 3 cl\\x\\ 2 <0 
— e J Qe — 2e J Pw + VC3C4 ||x|| 2 < 0 


(21) 

( 22 ) 


1. The closed-loop plant with the nominal controller and no disturbance is stable. This is the same as stating that 
the uncertainty is a non-destabilizing uncertainty. Then, the error equation of the open-loop system is 


Choose a Lyapunov candidate function 
Then 


e = A„,e — B®* J x 


V ( e ) = e T Pe 


V (e) = -e J Qe - 2 e J PB®* J x < -c 1 ||e|| 2 + 2 ||e|| ||™|| ©ox 
Since the plant is stable, V (e) < 0 which implies ||x|| is bounded by 


U < 


ci e 


Substituting into Eq. (22) yields 


2W0O 


II 1 1 2 , 0 Vc 3 c|cj ||e|| 2 ^ A 

-C.IH +2c,«M+ 4||ra||20S <0 


(23) 

(24) 

(25) 

(26) 
(27) 
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For stability, the coefficient of \\e\\~ must be negative. Therefore, there exists a maximum value V max for which 
0 < v < Vmax where 

4\\PB\\ 2 &1 _ 4 Kin ( B J A m T QA m l B ) ||Pfi|| 2 


Vmax — 9 

ClC 3 C| 


(28) 


Kin{Q)\\B J PA m l B\\ 

Note that v max is independent of the bound of the parametric uncertainty ©o if the uncertainty is non-destabilizing. 
V (e, ©) for the closed-loop system then becomes 


V (c,0) < —ci (1- 


e - 


C 2 


+ 1 C ^ C \ - vc 3 iwi 2 (||0|| -c 4 y 


i--*~ l--*- 

Vmax / Vmax 


Therefore, V (e,©) < 0 for the adaptive system implies either 


(29) 




(30) 


© > C 4 - 


cicj 


W — C4 + \ 

hwf(i-i) N 




VC 1 C 3 


= a 


(31) 


The closed-loop system is uniformly ultimately bounded with 


r< ||e|| <p = 


a < ||©|| < = 


/ (f 4 5 ) r 2 + X max (r 1 ) CC 

Kin (P) 

I Kax (P)r 2 + (r- 1 ) CC- 

/ uFf 


(32) 


(33) 


2. The closed-loop plant with the nominal controller has no stability guarantee. The uncertainty can be destabiliz- 
ing. Since e = x m — Eq. (22) can be expressed as 


-{Xm-x)' Q(Xm-x)-2(x m -xy Pw + VCt,cI\\x\\ 2 < 0 


(34) 


Therefore 

-Cl ||x m || 2 +2c 5 | \x m 1 1 ||x|| - Cl ||x|| 2 +2ciC2 ||x m || +2cic 2 ||x|| + VC 3 C 4 ||x|| 2 < 0 
where c 5 = Kax ( Q ) > © > 0. 

The adaptive system is stable if ci — vc 3 c 2 > 0 which yields 

ci Kin(Q)Kin{B T A- T QA~ l B) 

Vmax — 9 — .. , ,,9 . 

c 3C 4 \\B J PA m l B\\-®l 


(35) 


(36) 


Note that V max is now dependent on the upper bound of the parametric uncertainty © 0 . As the bound of the 
uncertainty increases, v max must be reduced to ensure stability of the closed-loop system. Thus, stability of the 
optimal control modification depends on the characteristics of the uncertainty. The adaptive law is guaranteed 
to be stable if a priori knowledge of the bound of the uncertainty exists. 

||x|| is then bounded from below by 


C 2 + C 5 ||x m | 


X > 


Cl - VC 3 C 4 


(37) 

□ 
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The modification parameter v for stability guarantee is dependent on the a priori knowledge of the bounds on the 
uncertainty as well as the disturbance to guarantee stability. Moreover, in the presence of a disturbance, i.e., c 2 i=- 0, 
then for the standard MRAC which corresponds to v = 0, the lower bound of © it ) is unbounded, as seen from Eq. 
(20). This implies an unbounded parameter variation for MRAC in the presence of a disturbance. This observation is 
consistent with the parameter drift phenomenon that the standard MRAC exhibits when a persistent excitation is not 
present in an adaptive regulator design. 

Example 1: Consider a first-order SISO system 


x = ax + bu + w 


(38) 


where a is unknown, b is known, and w{t) is a bounded disturbance where 

i'll * \2p+ 1 i 

W = P (\+t) p - 1 -a(l+t) p + rb 2 [ + 2 > p+l (1 +t) p 

An adaptive regulator is designed with the standard MRAC as 

u = k x x 
k x = —yx 2 b 

with k x (0) = 0. 

The behaviors of the closed-loop system with the standard MRAC are shown in the following table. 


p 

x(t) 

u{t) 

wit) 

k x {t) 

p> 0 



gjss. 


— 3 < p < 0 

eZ 





G c^oo 

e^foc 


gJK. 

p = -\ 

G c^oo 



gJK. 

p<-\ 

G J^OO 

e^foo 

G 



Table 1 - Boundedness of Example Adaptive System 


(39) 


(40) 

(41) 


For — j < p < — j, k x (t) becomes unbounded as t — > °°, whereas x(f), u(t), and w(t) remain bounded. This 
demonstrates the parameter drift phenomenon of the standard MRAC. If p , then all signals are bounded. 

The adaptive regulator is redesigned with the optimal control modification adaptive law 

kx = -y(x 2 b - vx 2 b 2 a m l k x ) (42) 


where a m < 0 is chosen such that a,„ = a + bk*. 

Let wo = max|w| and k Q = \k*\. Choose Q = 1, P = — 4|-. Then cj = 1, C 2 = — a,n 2 w ° ; C3 = b 2 a~ 2 , and C 4 = y. 
The ultimate bound of |x| is expressed as 


^ 2 T 2c 2 



+ + C ;+2c4 


ci 


Cl 



(43) 


V max is determined from the inequality in the limit as \x\ — > °°. This yields v max = , 4 , , . The ultimate bound of 

b a m Kq 

|x| is the largest solution of the inequality for any 0 < v < V max . 

The adaptive parameter k x (t) with the optimal control modification can be expressed in terms of the adaptive 
parameter k x (/) with the standard MRAC as 


k x 

1 — Va.m l bk x 


k x 


(44) 


The solution of k x ( t ) has a closed form which is given by 


k x = 


\-Va m 'bk x (0) 


V Cl n 


V a n 


exp { - va m 1 b [k x - k x (0)] } 


(45) 
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The standard MRAC exhibits a parameter drift as k x ( t ) — > — °°. With the optimal control modification, k x (t) 
is bounded as k x ( t ) — > — Therefore, the solution is guaranteed to be stable in the presence of a disturbance for 


The responses of the closed-loop system with a = 1, b = 1, p = —-■ pr, y x = 1 0, and x(0) = 1 with the standard 
MRAC and the optimal control modification with v = 0.1 are shown in Figs. 1 and 2, respectively. 


X 


£ 






Fig. 1 - Parameter Drift of MRAC for p = — and y x = 10 






Fig. 2 - Optimal Control Modification with v = 0.1 for p = — ^ and y x = 10 

III. Linear Asymptotic Property 

It has been shown that MRAC is non-robust with fast adaptation. The time delay margin of MRAC tends to zero as 
the adaptive gain tends to infinity. The optimal control modification adaptive law exhibits a linear asymptotic property 
as r — > °° or t — > oo. If the closed-loop system is stable, then © — > 0 which implies 

©T x ^ I (b j A-?Pb) 1 B T Pe (46) 

6 of 17 


American Institute of Aeronautics and Astronautics 


The closed-loop system then tends to an asymptotic linear system 


x = ( A m +^P~ l AlP+BQ* T 


x P l AlPx m +B m r 


(47) 


This system is stable for all v > 0 if A m + B&* is Hurwitz, but stable for 0 < v < v max if A m + B&* is not 
Hurwitz. 

Consider a special case when v = 1 corresponding to the optimal solution of the adaptive law, then 


A m +P-'AIP = P ' (pA m +A,Tp) = -P l Q (48) 

Since P > 0 and Q> 0, —P 1 Q < 0. The closed-loop poles of the ideal system with ©* = 0 are all negative real. 
The ideal system is exponentially stable with no high-frequency oscillations. 

The linear asymptotic property of the optimal control modification is quite useful since it can be analyzed using 
many existing linear analysis tools. Moreover, because of its linear asymptotic property, the closed-loop system has a 
scaled input-out behavior as F — > °°. That is, if r ( t ) is scaled by a multiplier c, then x(t) is scaled by the same amount. 

Theorem 2: Let x (f ) = xq ( t ) be the response due to r (t) = ro (f ), then if r (t) = cro (f ) where c is a constant, then 
it follows that x (t ) = cx o (t ) as T — > 

Proof: Since the the asymptotic closed-loop system is linear time invariant, then 


*= ( sI-A m -^P~ l AlP-B @* T ^j l -p- l AlPx m +B m r 

The transfer function of the reference model is 

X ^ = (sI-A m y 1 B m 

Then the closed-loop transfer function is obtained as 


x 

r 


si — A m P 1 AlP B&* 

v m 


--p-'AlP(sI-A m ) '+/ 


B„ 


(49) 


(50) 


(51) 


Thus, if r ( t ) = cro ( t ), then x (f) = cx o (f). The scale input-output behavior makes the optimal control modification 
more predictable than the a modification and e modification, both of which do not exhibit linear asymptotic properties 
for linear uncertain plants. 


□ 


The equilibrium value of x (t ) as t — > °° can be found by setting ,v = 0 

-l 


1 


*=-( A m + -P~ l AlP+B@* 


] -p- ] Aj n PA m ] +/ ) B m r 


(52) 


If v = 0, then the ideal property of asymptotic tracking of MRAC is recovered since 

-l 


v->0 


1 


x = — lim I A m + —P 1 aZp + B& 


v 


l -p- l AiPA m l + 1 \B m r 


1 


v->0 \ V 

The equilibrium value of the tracking error is given by 

1 


-l 


= - lim ( -P~ l AlP ) -p- l AlPA m l B m r = -A m l B m r = x m (53) 


e = x m — x = 


-a: 


A m + -p-'Aj n P + BO* 


-p-'Aj n PA m '+I 


BmT 


The largest norm of e(t) which can be interpreted as a steady state error when F — > °° is given by 

-l 


\e\\ = 


-AZ l B 


m i 


1 

V 


P- 1 AIP + B&* J 


p- l AZ,PA m l +1 ) B„ 


(54) 


(55) 


7 of 17 


American Institute of Aeronautics and Astronautics 


The linear asymptotic property also affords another advantage in that the stability margins of the system can be 
computed. 

Consider a first-order time-delay SISO system with an optimal control modification adaptive controller 


x = ax + b [u (t — t d ) + 6*x] 

u = k x x + k,-r — 6 (t)x 
0 = —Y(xeb~vx 2 a~ 1 b 2 d) 

with a and b known and a m = a + bk x < 0. 

As y — > °o, the equilibrium value of Ox is 



Then the closed-loop plant is given by 

x = ( a + bd*)x+ (bk x + -^-^x(t — t d ) — ^-x m (t — t d ) + bk r r (t — t d ) 

To simplify the analysis, let r (t) = 1 and x m (t) = 1. Then the characteristic equation with s = jco is 

jco — (a + bO*) — (bk x + (cos cot d — j sinof^) = 0 


which results in the following equations 


— (a + b9*) — [bk x + cos = 0 


CO 


(bk x +~^j sincofrf = 0 


The crossover frequency and time delay margin are computed as 


co = 


\j { bkx +< v ) 2 ~( a+b9 *) 2 


t d = — cos - 
CO 


a + b6* 

bk x +^f 


If v = 0, then the optimal control modification reverts to the standard MRAC whereupon 


(56) 

(57) 

(58) 

(59) 

(60) 


( 61 ) 

(62) 

(63) 

(64) 

(65) 


co = lim 

v->0 


\J { bkx+ ~v) 1 -( a + b6*) 2 


(66) 


td 


lim — cos 
v->0 CO 


V bk x + a -f) 


= 0 


(67) 


Thus the time delay margin for the standard MRAC goes to zero as the adaptive gain goes to infinity. On the other 
hand, for any 0 < v < V max , the optimal control modification adaptive law yields a non-zero time delay margin as 
the adaptive gain goes to infinity. This robustness property is required to maintain a sufficient stability margin of the 
closed-loop system. For a given time delay margin t d and specification of 0*, the modification parameter v thus can 
be computed to guarantee stability of the closed-loop system. 

Example 2: Let a = a m = — 1, b = b m = 1, 0* = 2, and r (t) = 1. The open-loop system is unstable. So the limiting 
value of v can be computed from Theorem 1 and from the linear asymptotic property as 


Vmax = min 


2 a„. 

be* 


a m +bd* 


= min (1,1) = 1 


(68) 


Choose v = 0.2 < 1. The time delay margin for the closed-loop system with the optimal control modification is 
calculated as 


CO = \l — 1 = 4. 8990 rad/sec 


(69) 
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1 


(70) 


td 



cos 


v = 0.2795 sec 


Since tj decreases with y, the time delay margin estimated with y — > °° is the minimum value of the time delay 
margin for any finite y < We see that for a small value of v, a significant increase in the time delay margin can be 
achieved. 

The steady state error is estimated to be 


e = 


- a , 


/ + {&n 


a -^+bQ* 

v 


-'i + i 

V 


b m r = —0.5 


The equilibrium value of 6 is computed to be 

e= e " 


Va ,„ 1 bx va m 1 b (x m — e ) 


= 1.6667 


(71) 


(72) 


A small time delay of 0.0020 sec in injected at the input in the simulation. This time delay causes the closed-loop 
system with the standard MRAC to go unstable. On the other hand. The closed-loop system with the optimal control 
modification is completely stable. The response of the closed-loop system with the optimal control modification is 
shown in Fig. 3. The simulation results agree very well with the equilibrium values of e and 0 . 






Fig. 3 - Optimal Control Modification with Fast Adaptation 

When a time delay equal to the time delay margin of 0.2795 sec is injected at the input, the closed-loop system 
begins to diverge, as shown in Fig. 4. Thus, the numerical evidence of the time delay margin is also in agreement 
with the analytical result. It should be noted that the time delay margin cannot be computed analytically with the cr 
modification and e modification because they do not possess linear asymptotic properties. 

To illustrate the scaled input-output linear behavior of the optimal control modification adaptive law, the reference 
command signal is doubled so that r (?) = 2. The simulation results are shown in Fig. 5. Both the reference model and 
the closed-loop system with the optimal control modification exhibit the scaled input-output property. For the optimal 
control modification, x = 3 for r (?) =2 which is twice x. = 1 .5 for r (?) = 1 . 

For comparison, the closed-loop responses with both the a modification and e modification are computed. For the 
a modification with a = 0.2, x = 2.1763 for r (?) = 2 versus x = 1.2787 for r (?) = 1. For the e modification with 
/i = 0.2, x = 1 .9725 for r (?) = 2 versus x = 1 .0015 for r (?) = 1 . Moreover, the e modification also exhibits oscillations 
with different frequencies and amplitudes as the reference command signal is doubled. This example illustrates that 
even if the open-loop uncertain system is linear, the closed-loop behaviors with the a modification and e modification 
are completely nonlinear. The closed-loop system with the optimal control modification adaptive law, on the other 
hand, tends to a linear system as the adaptive gain tends to infinity. 
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Fig. 4 - Optimal Control Modification with 0 = 0.2795 sec 






Fig. 5 - Scaled Input-Output Property of Adaptive Control 


IV. Linear Systems with Unmodeled Dynamics and Rohrs Counterexample 

Consider the system 

x = Ax + Bu + A(x,z,u) (73) 

Z = f(x,Z,u) (74) 

y = x (75) 

where z is the unmeasurable and unobservable state vector, A is the plant model error that is unknown and not accounted 
for, z is the unmodeled dynamics, and y is the plant output vector which is just the measurable state vector x. 

If model-reference adaptive control is used in a control design by assuming A = 0, then it is clear that such a control 
design can be non-robust as demonstrated by instability phenomena of MRAC for non-minimum phase systems. 

Research in robust adaptive control was motivated by instability phenomena of adaptive control. In fact, instability 
of adaptive control in the early 1960’s which contributed to the crash of one of the NASA X-15 hypersonic vehicles 
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caused a great deal of concern about the viability of adaptive control. Rohrs et al. investigated various instability 
mechanisms of adaptive control due to unmodeled dynamics in a paper entitled “Robustness of Adaptive Control in 
the Presence of Unmodeled Dynamics” published in 1982. 1 The Rohrs counterexample demonstrates the weakness of 
MRAC in its lack of robustness. 

The Rohrs counterexample is described by a first-order system with a pair of complex unmodeled poles 


2 229 

s+T s 2 + 30s + 229 U 


(76) 


The system has a relative degree 3 and is minimum phase. 

The reference model is specified as 

y m = -^T r (77) 

s + 3 

The reference model is strictly positive real (SPR) with relative degree 1 . Since the relative degree of the reference 
model is less than the relative degree of the plant, perfect tracking is not possible. Adaptive control of systems with 
relative degrees greater than 1 is generally more difficult since the model reference cannot be chosen to be SPR. 9 
The controller is given by 

u = k y (t)y + k r (t)r (78) 

ky = y x ye (79) 

k r = y r re (80) 

where e = y m — y. 

k y and k r are initialized with k y (0) = —0.65 and k r (0) = 1 . 14. 

The reference command signal is given by 

r = 0.3 + 1.85 sin 16. If (81) 


where the frequency 16.1 rad/sec is the frequency at which the closed-loop transfer function with k y = k y ( 0) has a 
-180° phase shift which implies a 0° phase margin. The closed-loop system is unstable, as shown in Fig. 6. 





Fig. 6 - Instability of MRAC by Rohrs Counterexample 

The Rohrs counterexample shows that the instability mechanisms can be due to the initialization of the adaptive 
parameters as well as the reference command signal. The underlying cause of instability is the lack of robustness of 
the closed-loop system. Changing either the initial condition of k y and or the frequency in the reference command 
signal can result in stabilization of the closed-loop system if it has a sufficient phase margin. 

The optimal control modification adaptive law can be designed to handle linear systems with unmodeled dynamics 
by utilizing the linear asymptotic property. 
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Suppose a plant with unmodeled dynamics is given by the following transfer function: 


y 

u 


W p (s) = k p 


Zp ( s ) 

R P (s) 


(82) 


where k p is a high-frequency gain, and Z p (s) and R p (s) are monic Hurwitz polynomials of degrees m p and n p , 
respectively, and n p — m p > 1 is the relative degree of the plant. 

The reference model is given by a transfer function 


ym 

r 


W m (s) — k m 


Z m (s) 
R m (s) 


(83) 


where k m is a high-frequency gain, and Z m (s) and R m (s) are monic Hurwitz polynomials of degrees m m and n m , 
respectively, and n m — in m > 1 is the relative degree of the reference model. 

Suppose the adaptive controller is designed with the optimal control modification as 


u = k y y + k,r (84) 

where 

k y = Yy (>' e - v y 2 ky) (85) 

k r = Yr {re — vr 2 k r ) (86) 

Let n p — m p > n m — m m . So the SPR condition is no longer possible to ensure tracking of the reference model. 
Stability of the closed-loop system cannot also be guaranteed with the standard MRAC. 

Using the linear asymptotic property of the optimal control modification, the asymptotic value of the adaptive 
controller u can be computed as Jy °° and y r — > °o. 


2y m - 2 y 


(87) 


The asymptotic closed-loop transfer function can now be computed as 


y = 2W p {s)W m (s) 
r 


2k m k p Z p (s)Z m ( 5 ) 


V + 2 W p ( 5 ) R,„ (s) (vR p (s) + 2 k p Z p ( 5 )) 


( 88 ) 


By a suitable selection of the modification parameter v, the asymptotic closed-loop transfer function can be de- 
signed to have closed-loop stability. Once the modification parameter v is chosen, the adaptive gains y v and y r can be 
selected to be any reasonable values without compromising closed-loop stability of the adaptive laws. 

Referring back to the Rohrs counterexample, the adaptive controller asymptotically tends to 


2 y m ~ 2 y 


6 r 

v(s + 3) 


2 y 

v 


(89) 


as Y y — > °° and y r — > 0 °. 

Then the asymptotic closed-loop transfer function is obtained as 


y _ 2748 

r ~ v (s + 3) (s 3 + 3 Is 2 + 259 s + 229 + ^) 


(90) 


Note that the closed-loop transfer function has a relative degree 4 while the transfer function of the reference model 
has a relative degree 1. This prevents the output y from tracking y m . 

The characteristic equation of y with input time delay is 


916 

s 3 + 3 Is 2 + 259s + 229 + e~ tdS = 0 

v 


(91) 


Substituting s = jco yields 


"3 ry . 

-jco 2 - 3 1 co 2 + 259 jco + 229 + (cos cota 


j sin cot d ) =0 
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This results in two frequency equations 


o y lv 

—31©“+ 229 H cos cotd = 0 

v 

, 916 

-© + 259© sin c 0t d = 0 

v 

We then obtain the cross-over frequency and phase margin as functions of the modification parameter v 


(93) 

(94) 


© 6 +443 © 4 + 52883© 2 + 229 2 - 



= 0 


(95) 


0 = cot d = tan 


/— © 3 + 259©\ 
V 31© 2 — 229 ) 


(96) 


The plot of v versus 0 and © is shown in Fig. 7. Notice that at v = 0.1 17, © = 16.1 rad/sec and 0=0. Note that 
the zero phase margin at the reference frequency of 16.1 rad/sec is consistent with the instability of the plant in the 
Rohrs counterexample. So the minimum value of v is v min = 0.1 17. At v = 1, the phase margin is about 78°. 




Fig. 7 - Phase Margin and Cross-Over Frequency of Rohrs Counterexample as Functions of v 

Suppose a 45° phase margin is select. Then, 0 = 45° occurs at v = 0.426 and © = 7.5099 rad/sec. The asymptotic 
closed-loop transfer function with v = 0.426 is 


y _ 2748 

~r ~ 0.426s 4 + 14.484s 3 + 149.952s 2 + 1344.556^ + 3040.662 


(97) 


The closed-loop plant is robustly stable with a phase margin of 45°. The asymptotic response y{t) and control 
signal u(t) evaluated analytically agree very well with the simulation results of y (t) and r(t), as shown in Fig. 8. 
Thus, the linear asymptotic property of the optimal control modification is demonstrated to be able to facilitate stability 
analysis of linear uncertain systems with unmodeled dynamics, time delay, or non-minimum phase behaviors. 

All the three robust modification schemes; namely, a modification, e modification , and optimal control modifica- 
tion exhibit minimum values of the modification parameters at which the plant in the Rohrs counterexample begins to 
stabilize. The a and e modification parameters can be found by trial and error. In contrast, the modification parameter 
v is found analytically by taking the advantage of the linear asymptotic property of the optimal control modification 
adaptive law. 
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Fig. 8 - Closed-Loop Response of Rohrs Counterexample with Optimal Control Modification 


V. Adaptive Control of Non-Minimum Phase Plants with Relative Degree 1 


Non-minimum phase plants are well-known to be very difficult to control by adaptive control. Output feedback 
adaptive control generally relies on the SPR property to ensure stability. For non-minimum phase plants, the SPR 
property does not exist, thereby destroying the ability to analyze stability of adaptive control using the SPR property. 
The linear asymptotic property of the optimal control modification can be used to analyze non-minimum phase plants 
in some instances. We will demonstrate such an analysis with the following example as a motivation. In future work, 
we will further explore this property to address in general adaptive control of non-minimum phase plants. 

Consider the following SISO plant 

x = ax + bu + gz (98) 

z = hz + lx + mu (99) 

y=x ( 100 ) 

where z is the unmeasurable state with internal dynamics, and the parameters a, g, h, l, and m are unknown, but b is 
known. 

The objective is to design an output feedback adaptive controller to enable tracking the following reference model 


U T ( \ I (s) 

ym — \S)r — k m r) , \ f — 

R,n (s) 


(101) 


where a m < 0 and k m = b m . 

The transfer functions of the plant is expressed as 


y 

u 


W p (s) = k p 


Z P (s) 


b(s — h)+ gm 
(s — a) ( s — h ) — gl 


( 102 ) 


where k p = b. 

Note that W m is SPR with a relative degree 1 . The plant is also with a relative degree 1 and is assumed to be stable, 
so R p (s) = (s — a) (s — h.)— gl is Hurwitz. 

The output feedback adaptive controller is desgined to be of the form 


b l (a m — 0i)sy — b 1 0zy + b l b m sr 
s-b-' 0 3 


(103) 


where Bn_, and O 3 are adaptive parameters. 
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Then the closed-loop plant is written as 


y = 


( gm — bh — 0 3 ) u + b m sr 


s 2 — ( a m + a + /z — 0i ) s — (gl — ah — 62 ) 

Let = a + h, 0, = gl — ah, and 0 3 = gm — bh. Then, the tracking error equation is obtained as 


e = a m e + 0 iy + d 2 / ydi + 63 / ud 1 




where e = y m — y, 0i = 0j — 0*, 02 = 02 — 0| , and 0 3 = 0 3 — 0|. 

The standard MRAC adaptive laws are 

01 = -TD'e 
02 = -72 ( f ydi ) e 


03 = -7? 


/' 


udi 1 e 


(104) 

(105) 

(106) 

(107) 

(108) 


If Z p (,v) is minimum phase, then 0\ — > 0( , 0 3 — > 0 2 \ and 0 3 — > 0) . The adaptive controller is stable and tends to 
the ideal controller 

* _ b ~ l \{a m -ei)s-e^\y + b- l b m sr 
,v + fc-'0* 

since b~ l 0 2 > 0 if Z p (s) is minimum phase. 

The stable zero of Z p (s) is cancelled by the stable pole of the adaptive controller to achieve perfect tracking of the 
reference model. 

On the other hand, if Z p (s) is non-minimum phase, b 1 0| < 0. Then, the adaptive controller has an unstable pole. 
The standard MRAC adaptive law is therefore unstable. 

Suppose the following optimal control modification adaptive laws are used: 


02 = -72 


03 = -73 


01 = -7i (y<? + Viy 2 0i) 

(L ydx ) e+n {k 

L 


ydi 02 


udi ) e + v 3 


' \ 2 

udi 0 3 


(110) 

(HI) 

(112) 


where Vi, V 2 , and v 3 are the modification parameter. 

Then the linear asymptotic property yields the equilibrium values of 0j, 02, and 0 3 


Then the adaptive controller tends to 

u = b~ l a m y + b 


Q 

II 

1 

v: 
* 3 i 

Vi 

(113) 

1 

V. 

II 

CD 

(114) 

s v 2 


s 

II 

s 1 

CO 

CD 

(115) 

S V 3 


1 7m y . 1 y,n-y , y m -y . ,_i, 

h b h b h b b m r 

(116) 

Vi V 2 v 3 


Note that stability of the adaptive controller is no longer affected by the non-minimum phase of Z p (s). Stability of 
the closed-loop plant is then determined by a proper selection of the modification v. 

Example 3: Consider the system 

x = ax + u — 2z + w (117) 
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Z = —z + u 


y=x 

where a < 0 is unknown, but a = — 1 for simulation purposes. 

The system is non-minimum phase with a transfer function 

(s— 1)m + (sT 1)w 
y (s — a)(s + l) 


(118) 

(119) 


(120) 


An adaptive regulator is designed as 


(s — 1) u 

y (s — a) (s + 1) 


u = k y y 

ky = -Yy (. y 2 + vAv) 


( 121 ) 

( 122 ) 

(123) 


Since the system is non-minimum phase, the standard MRAC corresponding to v = 0 will result in instability. 
Therefore, there exists a minimum value of v that stabilizes the closed-loop system. Using the linear asymptotic 
property, we can identify this minimum value analytically. 

Using the linear asymptotic property, we see that k y — > — i as y v — > °°. Therefore, the asymptotic closed-loop 
transfer function is 

l = i±U, (124) 

w (s-a)(s+l) + 4(s-l) 

The characteristic roots of the closed-loop transfer function are given by 


s 


1 — a 
2 




1 

v 


(125) 


Note that if v <~l the closed-loop plant is unstable. So, v > — i for closed-loop stability. The steady state 
closed-loop transfer function is equal to 

y i 


Cl - 


(126) 


Figure 9 shows the response of the closed-loop system with v = 2 for a unit step disturbance w(f) = 1. The 
numerical results are in agreement with the steady state value k y (t) = — j and the steady state response y(t) = 2. 




Fig. 9 - Closed-Loop Response of Non-Minimum Phase Plant 


16 of 17 


American Institute of Aeronautics and Astronautics 


VI. Conclusion 


This paper revisits the issue of adaptive control of linear uncertain systems with unmodeled dynamics by exploiting 
a feature of the optimal control modification adaptive law whereby the closed-loop system in the limit tends to a linear 
system asymptotically as the adaptive gain tends to infinity. For linear uncertain plants under certain conditions, the 
modification parameter v has a limiting value. Taking the advantage of the asymptotic closed-loop system, a stability 
analysis can be performed to compute the modification parameter required to stabilize the closed-loop plant. This 
approach can be applied to linear uncertain systems with unmodeled dynamics, time delay, and non-minimum phase 
behaviors. The Rohrs counterexample is revisited using the optimal control modification adaptive laws. Utilizing the 
linear asymptotic property, the cross-over frequency and phase margin of the asymptotic closed-loop plant are derived 
analytically. By determining a suitable value of the modification parameter for a desired phase margin, the plant 
in the Rohrs counterexample is shown to be stabilized by the optimal control modification adaptive law. The linear 
asymptotic property is also used to design adaptive control for non-minimum phase plants with relative degree 1. 
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